Senior Data Engineer
Publish Date: 05/20/2024
Job Title: Senior Data Engineer
Job Description: Design and implement data pipelines using Spark, Scala, and Python to ingest,
process and transform large volumes of data from various sources for projects.
Use Hive and Impala to query and manipulate data stored in data lakes or cloud-based storage systems.
Create and maintain ETL workflows using Oozie, a workflow scheduler,
to orchestrate data processing tasks and ensure data integration and synchronization.
Write SQL queries and leverage Impala to perform ad-hoc data analysis and generate reports on large datasets.
Design and implement data processing workflows using AWS Glue and AWS Lambda Functions.
Develop and maintain data pipelines using AWS EMR (Elastic MapReduce) for large-scale data processing.
Utilize AWS CDK (Cloud Development Kit) to automate the creation and management of cloud resources for data processing applications.
Collaborate with business analysts to ensure data accessibility and availability in AWS S3 for data analytics and reporting purposes.
Document code, data pipelines, and data processes for knowledge sharing and future reference.
Work Location: Various unanticipated work locations throughout the United States;
relocation may be required.
Must be willing to relocate.
Minimum Requirements:
Education: Master – Computer Science or Information Systems
Experience: One (1) year
Software Developer
Publish Date: 04/15/2023
Job Title: Software Developer
Job Description:
Design, develop and deploy project to AWS cloud using technologies including C#, Python, and JavaScript.
Manage automated builds using Azure pipelines to DEV, TEST, and PROD environments
to achieve continuous integration and deployments.
Design, code, develop and implement applications using C# .NET, ASP.NET MVC and Entity Framework.
Develop rich, fast, scalable and user-friendly web application using
HTML, Bootstrap, CSS3, JavaScript, jQuery and Angular.
Design and develop SQL Server Stored Procedures, Triggers, Views, Indexes, Scripts,
User defined functions for DML functionality for website using SQL Server and NoSQL.
As part of SCRUM development team (Agile), actively in sprint planning, release planning, review
and daily standup meetings to achieve quality deliverables.
Lead project planning sessions and coordinate with team and internal resources.
Manage project progress and adapt to work as required.
Manage relationships with stakeholders and oversee incoming and outgoing project documentation.
Perform software development, including requirements analysis, architecture and product specifications,
coding, quality assurance testing, deployment, documentation and support.
Work Location:
Various unanticipated work locations throughout the United States;
relocation may be required.
Must be willing to relocate.
Minimum Requirements:
Education: Bachelor's/Master's – Computer Science or Information Systems or other related work experience
Experience: Six (6) months
Please refer our
Referral Policy