Position: Senior AWS Data Engineer
Department: DSB (Data Science Branch)
Location: 100% Remote
No C2C or Sponsorship
Overview: We are seeking Senior AWS Data Engineers to support large-scale data operations in both cloud and on-premise computing environments. This role involves designing, building, and managing infrastructure to ingest, store, and analyze massive volumes of astronomical data. You'll collaborate closely with software developers and astronomers to deliver science-ready data products via our Data Access APIs. Key Responsibilities:
- Design and implement robust data management solutions for high-volume, high-variety, and high-veracity astronomical datasets in both cloud and on-premise environments.
- Analyze and assess current data systems; identify performance or functionality issues and implement scalable, optimized solutions.
- Lead or contribute to proof-of-concept and pilot projects for new technologies and system improvements.
- Evaluate data access patterns and SQL queries, recommending and implementing enhancements.
- Design and develop database schemas, indexes, data migration utilities, and stored procedures/functions.
- Support the development and optimization of data APIs for scientific data access.
- Participate in day-to-day database operations, including troubleshooting, debugging, and production issue resolution.
- Monitor and optimize database performance and availability.
Required Skills & Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 8-15 years of hands-on experience in data engineering and data management (DOE for senior level).
- Strong background in data modeling and management of large-scale database systems.
- Advanced proficiency in SQL, including analytical functions and complex query development.
- Expertise in database performance tuning and optimization of data pipelines.
- Proficient in Python programming.
- Experience with cloud databases, particularly Amazon Web Services (e.g., Amazon RDS).
- Familiarity with cloud data storage architectures and access strategies.
- Hands-on experience with PostgreSQL and SQL Server, including migration between systems.
- Exposure to tools and frameworks such as Kafka and GraphQL.
**This position requires U.S. Citizenship or Permanent Residence (Green Card) in order to meet ITAR requirements to work in these positions. No C2C or Sponsorship available. Equal Opportunity Employer, including disability and protected veteran status
|