SENIOR AWS DATA LAKE DEVELOPER AT MOTOR INFORMATION SYSTEMS We are actively seeking a hands-on data engineer who possesses a strong passion for designing, optimizing, refactoring, and upgrading complex data solutions and who can help us design, develop and model Data Lakes within AWS. Required Experience (Must Have) • Expert Python Developer (Minimum Two Years of Experience) • Strong AWS Experience (Minimum Three Years of Experience) o Demonstrated Data Lake Experience (with S3 as Storage) o Expert Lambda Developer o Expert in Fargate / Containers o Expert in Step Functions / State Machines o Expert in Cloud Formation • Experience with Semi-Structured Data o XML, CSV, Parquet • Experience with Larger Data Pipelines (Multiple Terabytes) • Experience with Linux • Strong Automation Experience Helpful Experience (Nice to Have) • Experience with AWS Glue / Spark • Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy) • Experience with Git and Azure DevOps • Experience with Relational Databases • Experience with Neo4j • Experience with Kettle and/or Apache Hop • Experience with Automotive Data / Industry • Experience with Agile / Scrum Primary Responsibilities • Analyze large, and complex, data sets • Design, develop and coordinate the generation of Data Pipelines • Model complex data sets • Work collaboratively with team to plan and solve complex problems • Design for, or optimize existing pipelines, for performance EEO EMPLOYER
Sr. AWS Cloud Developer