logo

View all jobs

Data Engineer, SME, TS/SCI w/Poly

McLean, VA · Information Technology
BreakForth Solutions, Inc. (BSi) is seeking a Data Engineer, SME, and TS/SCI and favorable Poly to join our team of dynamic professionals. If you are seeking a rewarding opportunity to express your talents and grow professionally, please contact us at www.BreakForthSolutions.com to apply or respond to this requisition today

Duties and Responsibilities
  • Create and maintain a data pipeline architecture
  • Assembling large, complex sets of data that meet mission requirements
  • Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
  • Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS, SQL, NiFi technologies
  • Build analytical tools to utilize the data pipeline, providing actionable insight into data performance including operational efficiency and customer acquisition
  • Working with mission stakeholders and assist them with data-related technical issues
  • Working with technology stakeholders to support their data infrastructure needs while assisting with data-related technical issues

Skills and Qualifications
  • Ability to build and optimize data sets, 'big data' data pipelines and architectures
  • Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
  • Excellent analytic skills associated with working on unstructured datasets
  • Ability to build processes that support data transformation, workload management, data structures, dependency and metadata

Required Experience
  • Bachelor’s degree in information systems, informatics, statistics, or computer science/software engineering
  • Minimum of five years of experience using some of the below software and tools:
    • Big data tools like Kafka, Spark and Hadoop
    • Relational NoSQL and SQL databases including Cassandra and PostgreSQL
    • Workflow management and pipeline tools such as Airflow, Luigi and Azkaban
    • AWS close services including Redshift, RDS, EMR and EC2
    • Stream-processing systems like Spark-Streaming and Storm
    • Object function/object-oriented scripting languages including Scala, C++, Java and Python.
    • Data workflow orchestration tools including Pentahoe or Apache NiFi
BreakForth Solutions, Inc. (BSi) is an equal employment opportunity company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, or national origin.
Powered by