Yayınlanma: 2 hafta önce
Senior Data Engineer – Python, PySpark & AWS
- İş yerinde
- Airflow
- AWS
- Data Engineering
- Kafka
$60/hr W2
İlan açıklaması
Senior Data Engineer – Python, PySpark & AWS
Location: Plano, TX
Relocation : Open
Open for W2 only- No c2c/1099 or third party resumes
Due to the nature of the roles client is only accepting USC/GC /GC EAD only no other visas accepted.
Role Overview
We are seeking a hands-on Senior Data Engineer with strong Python, PySpark, and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads, cloud infrastructure, and data orchestration.
Key Responsibilities
- Develop, test, and maintain ETL/ELT data pipelines using Python and PySpark.
- Build and support big-data processing solutions on AWS using S3, EMR, and Lambda.
- Implement infrastructure automation using Terraform.
- Develop data integrations using REST APIs, Kafka, and MQ messaging.
- Support data storage and retrieval using Cassandra.
- Orchestrate and monitor workflows using Airflow, Control-M, and native schedulers.
- Troubleshoot pipeline failures and optimize performance, reliability, and data quality.
Required Skills
- Strong hands-on Python and PySpark experience.
- Experience with big-data processing and production data pipelines.
- AWS experience with S3, EMR, and Lambda.
- Working knowledge of Terraform.
- Familiarity with Kafka, MQ messaging, REST APIs, Java, and Cassandra.
- Experience with Airflow, Control-M, or other workflow scheduling tools.
Preferred: Databricks experience and exposure to machine-learning workflows.
SCI Solutions Global şirketinin diğer ilanları
Data Engineer – Python & AWS Glue Data Platforms
SCI Solutions Global Plano, Teksas, Amerika Birleşik Devletleri🇺🇸
Senior Cloud Data Engineer – Python + AWS
SCI Solutions Global Plano, Teksas, Amerika Birleşik Devletleri🇺🇸
Python Data Engineer
SCI Solutions Global Plano, Teksas, Amerika Birleşik Devletleri🇺🇸
Cloud Data Engineer(Python)
SCI Solutions Global Plano, Teksas, Amerika Birleşik Devletleri🇺🇸
Senior Data Engineer
SCI Solutions Global Uzaktan · Amerika Birleşik Devletleri 🇺🇸
Data & Cloud Services Engineer
SCI Solutions Global Plano, Teksas, Amerika Birleşik Devletleri🇺🇸
Data Engineer
SCI Solutions Global Şikago, Illinois, Amerika Birleşik Devletleri🇺🇸
Data Center Engineer
SCI Solutions Global Columbus, Ohio, Amerika Birleşik Devletleri🇺🇸
Diğer ilanlar: Amerika Birleşik Devletleri
Teacher Aide/ Support Staff
Ascend Rehab Services Inc Antioch, Kaliforniya, Amerika Birleşik Devletleri🇺🇸
Board Certified Behavior Analyst, BCBA (Pediatric Outpatient Clinic)
Ascend Rehab Services Inc Livermore, Kaliforniya, Amerika Birleşik Devletleri🇺🇸
The Great Escape Room - Royal Oak
The Great Escape Room Royal Oak, Michigan, Amerika Birleşik Devletleri🇺🇸
Diesel Mechanic
LATS Lawton, Oklahoma, Amerika Birleşik Devletleri🇺🇸
Creative Marketing Manager
Portal Space Systems Bothell, Washington, Amerika Birleşik Devletleri🇺🇸
Morning - Line Cook / Prep
Huey Magoo's MAD Amerika Birleşik Devletleri 🇺🇸