掲載:2週間前
Data Engineer
- 出社
- 期間限定
- Airflow
- AWS
- Azure
- Data Engineering
$100,000 - $120,000 年
仕事内容
Data Pipeline Development & IntegrationDesign, build, and maintain scalable ETL/ELT pipelines to extract, transform, and load data from multiple sources.Develop automated data integration solutions supporting enterprise applications, analytics, and reporting.Integrate structured and semi-structured data from APIs, relational databases, cloud platforms, and third-party systems.Develop batch and real-time data processing solutions.Troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks.Data Warehousing & ArchitectureDesign and optimize enterprise data warehouses, data lakes, and lakehouse architectures.Develop efficient data models, schemas, and transformations to support business intelligence and analytics.Build and maintain cloud-based data solutions using AWS, Microsoft Azure, or Google Cloud.Optimize SQL queries, database performance, and data processing workloads.Implement data partitioning, indexing, and storage optimization strategies.Data Quality & GovernanceDevelop automated data validation, monitoring, and quality assurance processes.Ensure data accuracy, consistency, reliability, and availability across enterprise systems.Implement data governance standards, access controls, and security best practices.Maintain documentation for data pipelines, architecture, and transformation logic.Support compliance with organizational data privacy and security requirements.Cloud Engineering & AutomationDevelop and maintain cloud-native data pipelines and processing workflows.Utilize orchestration tools such as Apache Airflow, Azure Data Factory, or similar technologies.Implement CI/CD practices for data engineering workflows.Automate data processing, monitoring, and infrastructure deployment.Collaborate with DevOps and infrastructure teams to improve scalability and reliability.Analytics & AI SupportPartner with business intelligence and analytics teams to deliver reliable datasets for reporting and dashboards.Develop curated data models supporting Power BI, Tableau, and other visualization platforms.Build data pipelines supporting machine learning, predictive analytics, and AI applications.Collaborate with AI engineers and data scientists to prepare, transform, and deliver data for model development and production applications.Identify opportunities to improve business processes through better data integration and automation.
アメリカ合衆国のその他の求人
Maintenance Tech - Brownsburg
Crestline Property Management LLC Brownsburg, インディアナ州, アメリカ合衆国🇺🇸
Part Time/ On Call Maintenance - Crawfordsville
Crestline Property Management LLC Crawfordsville, インディアナ州, アメリカ合衆国🇺🇸
Senior Manager, Development and Strategic Partnerships
Credit Builders Alliance Washington, ワシントン D.C., アメリカ合衆国🇺🇸
Residential Treatment Specialist - Men's Unit (Full-Time)
Community and Family Resources デモイン, アイオワ州, アメリカ合衆国🇺🇸
PCA/Med tech (Full-time/Part-time)
Colonial Heights Senior Living フローレンス, ケンタッキー州, アメリカ合衆国🇺🇸
Residential Structural Project Engineer (EIT or PE)
Orion Placement ミルバレー, カリフォルニア州, アメリカ合衆国🇺🇸