Data Full Stack Engineer
12 months
REMOTE
Description:
Seeking a Sr. Data & Full-Stack Engineer with strong experience in API development in Python and robust data engineering. Engineers should have a proven track record of writing reliable, high-performance, production-grade code grounded in strong system design, data modeling, and engineering best practices. The ideal candidate will provide technical leadership in building scalable end-to-end web applications, driving system design, and managing cloud-native data processing pipelines. Domain experience working within Identity and Access Management is a strong plus, but not strictly required.
Responsibilities:
- Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services.
- Frontend UI: Build and maintain responsive, modular web applications utilizing React, JavaScript, HTML, and CSS.
- Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with tools like Apache Airflow. Process diverse data formats across SQL data warehouses and unstructured sources, collaborating cross-functionally to deliver scalable data solutions.
- Data Modeling & Storage: Optimize performance and design schema models across relational PostgreSQL, SQL Server and NoSQL DynamoDB databases, along with data warehouses like Snowflake.
- DevOps & Infrastructure: Manage infrastructure monitoring with CloudWatch, incident response, and CI/CD pipelines leveraging Jenkins, Docker, Kubernetes/EKS, and Git/GitHub. Experience utilizing and developing within AWS services. Troubleshoot and resolve issues related to AWS services and infrastructure.
- Testing: Establish rigorous automated unit and integration test suites to ensure high reliability and system stability.
- Cloud Optimization: Optimize data storage and processing using cloud-native services and technologies such as AWS S3, AWS Glue, AWS Batch, Lambda, and related AWS services.
Skills:
- Languages & Frameworks: Python, Advanced SQL, JavaScript, HTML, CSS, React (Nice to have: Java, Kotlin, C#)
- Data Engineering & Analytics: Apache Spark, pySpark, Snowflake, AWS Glue, AWS Batch, ETL pipeline design, Apache Airflow
- Databases & Storage: AWS S3, Relational databases PostgreSQL, SQL Server, NoSQL DynamoDB
- API & Backend Development: REST API design, GraphQL/Apollo, Boto3, API contracts, microservices, low-latency API integration Nice to have: SQS/SNS messaging
- AWS Infrastructure & Cloud Services: Lambda, ECS, EC2, RDS, Route53, S3, CloudWatch, serverless architectures
- DevOps & Testing: Jenkins, Docker, Kubernetes/EKS, CI/CD pipelines, Git/GitHub, automated testing unit/integration
- Strategic Nice-to-Haves: IAM, cybersecurity data environments, access governance, identity platforms, Spring Batch, event-driven architectures
|