Join to apply for the Senior Data Engineer role at xScion Solutions
Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle
Overview
As a Senior Data Engineer, you will design, develop, and operationalize large-scale enterprise data solutions in the AWS cloud, migrate on-premise data platforms to cloud-native stacks, and contribute to architecture discussions.
Responsibilities
- Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
- Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop to AWS-native data stack
- Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
- Participate in discussions related to architecture, design, and product development to translate business requirements into technical solutions
- Take responsibility for complete user stories through analysis, design, development, and testing per project timelines
- Develop and maintain scripts to automate batch jobs
- Support and maintain existing applications, troubleshooting and resolving technical issues
- Follow technical best practices and internal processes while complying with information security controls
- Maintain existing data solutions on Hadoop stack (HDFS, Oozie, Impala, Hive) with enhancements during cloud migration
To Be Successful, You Need
- Bachelor's Degree in Computer Science, Information Technology, or related field
- 7+ years of software development experience related to data engineering
- Hands-on experience in Java, Python, or Scala with the ability to write complex SQL queries
- Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
- Experience deploying software solutions to the cloud through CI/CD in a DevOps model
- General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
- Hands-on experience with Hadoop technologies (HDFS, Oozie, Impala, Hive)
- Experience with Infrastructure as Code tools (Ansible, Terraform, or Cloud Formation)
- Experience in Hadoop-based Big Data architecture and solutions
- Experience in Agile development with tools like Jira or Rally
- Proficiency with UNIX commands and shell scripts
- Strong communication and teamwork skills
- Nice to have: experience with RDBMS and data warehouses
- Nice to have: experience with Machine Learning technologies and data visualization tools
Benefits and About xScion
Why xScion?
- Culture of excellence and recognition, including awards for Best Places to Work
- Opportunities for rapid growth and involvement in digital transformation across industries
- Commitment to professional development, including communities of practice, partnerships, and certifications
- Focus on impact and inclusion; we are a woman-owned organization with an inclusive culture
- Comprehensive benefits: medical, dental, 401(k) match, flexible spending and more, plus generous time off and flexible work options
All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.
You will be added to our talent community when you apply to this job. You may opt out at any time.
Want to Learn More about xScion? Check us out at or on LinkedIn, Twitter, and Glassdoor.
#J-18808-Ljbffr