Data Analyst Job at Aditi Consulting in San Francisco

Salary

$120k - $120k/Year

Responsibilities

• Design, develop, and maintain ETL/ELT workflows using AWS Glue, Azure Data Factory, and Databricks.
• Write and optimize PySpark/Scala scripts for large-scale data transformations and cleansing.
• Automate data ingestion from RDBMS, APIs, flat files, or streaming sources (Kafka, Kinesis).
• Monitor and troubleshoot data pipeline performance, debugging failed jobs and optimizing runtime and cost.
• Manage and deploy cloud infrastructure via Terraform, CloudFormation, or Azure DevOps pipelines.
• Provision and maintain S3 buckets, Redshift clusters, Azure Data Lake Storage, and related services.
• Configure IAM roles, security groups, and encryption to ensure compliance and data protection.
• Participate in CI/CD workflows, performing code reviews and automating build and deployment processes.
• Implement and monitor data validation rules, quality checks, and error handling within ETL processes.
• Document data flow diagrams, schema changes, and transformation logic for internal teams.
• Collaborate with Data Scientists and Analysts to support reporting, analytics, and ML pipelines.
• Partner with Business Analysts to translate functional requirements into technical solutions.
• Participate in Agile ceremonies (stand-ups, sprint planning, retrospectives) and track deliverables.
• Develop Power BI, Tableau, or QuickSight dashboards for business and operational insights.
• Analyze and optimize pipeline logs, storage usage, and compute costs in CloudWatch/Azure Monitor.
• Experiment with modern data lake frameworks such as Delta Lake, Iceberg, or Lake Formation.
• Enforce data governance, naming conventions, and metadata standards across environments.
• Support ad hoc queries, performance tuning, and root-cause analysis for data-related issues.
• Implement DevOps best practices for reliability, scalability, and automated infrastructure management.
• Ensure all data solutions adhere to security, compliance, and high-availability standards.

Pay Transparency

The typical base pay for this role across the U.S. is $120k - $120k/year. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full‑time employees are eligible for benefits including medical, dental, and vision benefits; health savings account option; paid time off; 401(k) plan participation with employer match; insurance coverage; and discretionary performance or recognition bonus.