ClearanceJobs
Data Engineer
Design, build, and maintain scalable data pipelines using tools like Apache NiFi, Airflow, or equivalent orchestration systems. Work with structured and semi-structured data using SQL and NoSQL systems (e.g., PostgreSQL, MongoDB, Elasticsearch, Neo4j). Develop services and integrations using Java (primary) and optionally Python for ETL workflows and data transformation. Integrate data from internal and external REST APIs; handle data format translation (e.g., JSON, Parquet, Avro). Optimize data flows for reliability and performance, and support large-scale batch and streaming data jobs. Implement and document ETL mappings, schemas, and transformation logic aligned with mission use cases. Collaborate with software, DevOps, and AI teams to support downstream data science and ML workflows. Use Git-based workflows and participate in CI/CD processes for data infrastructure deployments. Contribute to application specifications, data quality checks, and internal documentation. Qualifications: B.S. degree in Computer Science, Technology, Engineering, or a relevant field. Experience in data engineering, backend software engineering, or data integration roles. Strong experience with Java development in data pipeline or ETL contexts; Python is a plus. Proficiency with SQL and NoSQL databases, including query optimization and large dataset processing. Familiarity with data integration tools such as Apache NiFi, Airflow, or comparable platforms. Knowledge of RESTful API interactions, JSON parsing, and schema transformations. Exposure to cloud environments (especially AWS: S3, EC2, Lambda) and distributed systems. Comfortable with Git-based version control and Agile team practices. Industry experience, preferably within the defense industry and/or intelligence community or related sectors, a plus. Capability to work collaboratively in interdisciplinary teams. Awareness of ethical considerations and responsible AI practices. Excellent problem-solving skills, attention to detail, and ability to thrive in a fast-paced, collaborative environment. Experience with data messaging and streaming technologies (e.g., Kafka) (nice to have, not required). Understanding of IAM/security concepts in data environments (e.g., role-based access, encryption) (nice to have, not required). Exposure to data modeling, time-series data analysis, or graph databases (e.g., Neo4j) (nice to have, not required). Familiarity with Spark or other distributed processing frameworks (nice to have, not required). Our Commitment: We would love to have you join our team! ECCO Select is committed to hiring and retaining a diverse workforce. ECCO Select's policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Equal Employment Opportunity is The Law This Organization Participates in E-Verify
Design, build, and maintain scalable data pipelines using tools like Apache NiFi, Airflow, or equivalent orchestration systems. Work with structured and semi-structured data using SQL and NoSQL systems (e.g., PostgreSQL, MongoDB, Elasticsearch, Neo4j). Develop services and integrations using Java (primary) and optionally Python for ETL workflows and data transformation. Integrate data from internal and external REST APIs; handle data format translation (e.g., JSON, Parquet, Avro). Optimize data flows for reliability and performance, and support large-scale batch and streaming data jobs. Implement and document ETL mappings, schemas, and transformation logic aligned with mission use cases. Collaborate with software, DevOps, and AI teams to support downstream data science and ML workflows. Use Git-based workflows and participate in CI/CD processes for data infrastructure deployments. Contribute to application specifications, data quality checks, and internal documentation. Qualifications: B.S. degree in Computer Science, Technology, Engineering, or a relevant field. Experience in data engineering, backend software engineering, or data integration roles. Strong experience with Java development in data pipeline or ETL contexts; Python is a plus. Proficiency with SQL and NoSQL databases, including query optimization and large dataset processing. Familiarity with data integration tools such as Apache NiFi, Airflow, or comparable platforms. Knowledge of RESTful API interactions, JSON parsing, and schema transformations. Exposure to cloud environments (especially AWS: S3, EC2, Lambda) and distributed systems. Comfortable with Git-based version control and Agile team practices. Industry experience, preferably within the defense industry and/or intelligence community or related sectors, a plus. Capability to work collaboratively in interdisciplinary teams. Awareness of ethical considerations and responsible AI practices. Excellent problem-solving skills, attention to detail, and ability to thrive in a fast-paced, collaborative environment. Experience with data messaging and streaming technologies (e.g., Kafka) (nice to have, not required). Understanding of IAM/security concepts in data environments (e.g., role-based access, encryption) (nice to have, not required). Exposure to data modeling, time-series data analysis, or graph databases (e.g., Neo4j) (nice to have, not required). Familiarity with Spark or other distributed processing frameworks (nice to have, not required). Our Commitment: We would love to have you join our team! ECCO Select is committed to hiring and retaining a diverse workforce. ECCO Select's policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Equal Employment Opportunity is The Law This Organization Participates in E-Verify