Logo
SelectMinds

Sr Data Engineer L3

SelectMinds, Dallas, Texas, United States, 75215

Save Job

Replies within 24 hours

Benefits:

Hybrid Long Term Opportunity for advancement Senior

Data Engineer Location: Dallas, TX (Hybrid-3 days onsite)

Duration: Long-term Project

Interview: In-person

Data Engineer L3 Role

Roles and Responsibilities:

Migrate data from On-prem to AWS Redshift with zero data loss. Build batch and real-time data pipelines using Python . Set up and manage Kafka on AWS for streaming data. Automate ETL workflows using AWS Glue and store data in S3. Design data solutions in Redshift for fast querying. Create reusable frameworks to reduce development time and improve code. Build dashboards and reports for client data insights. Use GitLab CI/CD for testing and deployments. Work with AWS tools like Lambda, SQS, SNS, Glue, DynamoDB, OpenSearch, and more. Develop tools to generate mock data (JSON, CSV, XML). Deploy containerized apps using Kubernetes. Follow best practices to ensure data security and compliance. Qualifications:

Strong experience in Python and cloud technologies - AWS. Good understanding of Kafka, ETL, and data warehouses. Familiarity with CI/CD, boto3, and Kubernetes is a big plus.

Flexible work from home options available.

Compensation: $55.00 - $65.00 per hour

About Us

We work to deliver profitability in your business - with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses.

Work Approach

Our Philosophy Our Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.

Work Policy

We promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution.

The Future

SelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.