Senior Data Engineer

The role

This person will support the U.S. Special Operations Command through data governance and data modernization efforts. They will be embedded within the SOCOM HQ to provide technical capability for integrating complex data.

What you will do

• Develop, maintain, and test infrastructures for data generation to transform data from various structured and unstructured data sources.
• Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure.
• Create and maintain optimal data pipeline architecture.
• Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources.
• Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs.
• Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
• Apply distributed systems concepts and principles.
• Administrate cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS).
• Coordinate with stakeholders to assist with data-related technical issues and support data infrastructure needs.

Required qualifications

• Minimum of 1-year experience.
• Bachelor's degree in a STEM field.
• Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No-SQL engines.
• Proficient in modeling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations.
• Proficiency in programming language(s).
• A Secret Clearance is required.
• Ability to work onsite 5 days per week.
• Experience working with large financial datasets.

Nice to have

• Preference towards Computer Science and Software Engineering.
• Top Secret clearance with SCI eligibility
• Familiarity with Palantir Foundry
• Familiarity with DoW

Benefits

• Performance-based bonuses
• Medical coverage
• Dental coverage
• Vision coverage
• 401(k) plan with company match
• Substantial paid time off and holidays
• Income protection benefits

Before you apply

• A Secret Clearance is required.

About the company

Clarity Innovations is a national security partner delivering solutions to the Intelligence Community and Department of Defense. They focus on software and data engineering to address national security challenges.