Senior Associate Data Engineering

Employer: Sapient Corporation

Job Title: Senior Associate Data Engineering

Job Requisition: 6630.7639.6

Job Location: 6021 Connection Drive, Irving, Texas 75039. Will work from company office in Irving, TX and various unanticipated client sites and Sapient offices nationally. Telecommuting available on a hybrid basis at company discretion.

Job Type: Full Time

Rate of Pay: $128,320.50 to $134,736.52

Duties: Develop and implement a set of techniques or analytics applications to transform raw data into meaningful information using data-oriented programming languages and visualization software. Responsible for extracting the data from heterogenous sources, analyzing the data, transforming the data as per the business rules and loading the data in to target data systems by creating ETL data pipelines using various technologies. Develop complex real time and batch-processing data pipelines that handles large volumes of data ensuring scalability and performance. Design and implement data models and schemas to support business requirements. Monitor and optimize data infrastructure performance which includes query tuning and resource utilization. Integrate the data from various source systems to ensure consistency and availability for analysis. Involve in deploying data pipelines to different environments. Involve in bug fixes, production deployment activities and writing python scripts to automate the process. Design, develop and maintain the data pipelines. Optimize data transformation processes to support analytical and reporting requirements. Integrate data from disparate sources and formats to create unified datasets for analysis and reporting purposes. Monitor the data pipelines and fix them in case of failure. Implement security measures and compliance standards to protect sensitive data such as PII and PHI data using data encryption and access control. Collaborate with cross functional teams to understand data requirements and deliver solutions.

#LI-DNI

Requirements: Employer will accept a Bachelor's degree in Computer Science, Information Technology, Engineering or a related field followed by three years of progressive, post-baccalaureate experience in the job offered or three years of progressive, post-baccalaureate experience in any occupation in which the required experience was gained.

Position requires three years of experience in the following.

1. Create complex data pipelines to migrate the data from source systems to Azure Data Lake Storage gen2 using Azure Data Factory.
2. Utilize Azure Data Bricks and big data technologies (Spark, Spark SQL and Kafka) to create real time and batch processing data pipelines.
3. Clean, transform, and load data into systems including ADLS, Kafka and Adobe experience platform (AEP).
4. Create Python scripts to automate the process of retention of delta tables, optimizing the infrastructure cost.
5. Write SQL queries to analyze data while unit testing and optimize complex SQL queries for business validation.
6. Create visualized and interactive dashboards and reports using Power BI and Tableau.
7. Develop optimized spark jobs by tuning spark configurations and partitioning the data.

Will work from company office in Irving, TX and various unanticipated client sites and Sapient offices nationally. Telecommuting available on a hybrid basis at company discretion.

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients' businesses through designing the products and services their customers truly value.