Careers

Data Engineer

  • National Geospatial IntelligenceAgency
  • 215 Sinclair Ave, South Roxana, IL 62087, USA
  • Nov 09, 2020
[Information Technology]

Job Description

Job Summary processing systems. They clean, prepare,and optimize data for consumption through the design andconstruction of massive reservoirs for big data. They solveproblems associated with database access and integration andunstructured data sets to provide clean, usable data for customersand IT counterparts. These engineers serve as integrators betweendata architects, data scientists, and other data consumers. Theyapply knowledge of scripting tools, programming languages,standards, and software packages to build the data pipelines thatenable faster, better, data-informed decision-making within theAgency. Additional Job Information ADDITIONAL INFORMATION: TheNational Geospatial-Intelligence Agency (NGA) serves as the worldleader in providing timely, relevant, accurate and actionablegeospatial intelligence (GEOINT). NGA's civilian, military andcontract personnel evaluate imagery, maps, charts, multiple layersof foundation data - such as terrain, elevation and gravity - andthe full spectrum of visible and invisible light in order to helpusers visualize what is happening at a particular place and time.NGA is in search of Data Engineers who understand data, dataarchitectures, data pipeline infrastructure, cloud solutions, andsecurity best practices. Data Engineers create data infrastructureand integrated data pipelines; transforming, enriching, anddelivering data for consumers. They may work independently and/oras part of a team of data and non-data professionals on projects ofvarying complexities. They will design logical and physical datamodels for data warehousing; develop robust data models, datadictionaries, and data flow diagrams. Data Engineers must be ableto operate at the tactical and strategic level while working in adynamic and sometimes ambiguous environment to deliver impactfulresults. They will leverage their strong interpersonal skills toeffectively communicate with mission owners at varying levelsinside and outside the Agency. As a Data Engineer, you will betasked against the Agency's biggest data challenges in support ofmissions such as National Intelligence, National Security, MilitaryOperations, and Disaster Relief and Preparedness, for a diverseaudience including the Department of Defense, the IntelligenceCommunity, and senior government officials up to and including theUnited States Congress and the President of the United States.Other duties may include: * Utilize a variety of languages andtools (e.g., scripting languages) to build data pipelines to pulltogether information from different source systems. * Design,construct, install, test, and maintain highly scalable datamanagement systems; * Develop data set processes for datadiscovery, modeling, mining, and production. * Integrate andprepare large, complex data sets that meet functional/non-functional business requirements. * Design and implement highperformance data pipelines for distributed systems and dataanalytics for customers. * Build, deploy, operate, and maintain bigdata analytics infrastructure. * Orchestrate large PB sized datastorage and compute clusters across bare-metal and cloud. * Deployand manage infrastructures based on Docker, Kubernetes, orOpenStack, and public Clouds such as Azure, AWS or Google CloudPlatform. * Create tool-chains for analytics and data scientistteam members that assist them in building and optimizing AIworkflows. * Experience with engineering data pipeline fromcollection and processing to visualization of SQL and NOSQL cybersecurity data sources for threat analysis and modelling. * Workwith Agency data and machine learning experts to improvefunctionality in our data and model life cycle managementcapabilities. * Develop enterprise interoperable coding and datastandards and create processes to ensure use of enterprise-widedata architecture capabilities. * Solve problems and deliversolutions with database access and data integration, define dataconflation, fusion, and de-confliction rules. * Collaborate withdata architects, data scientists, data stewards, and customers toenable more efficient and effective data-informed decision-making.* Apply expert knowledge of scripting, tools, programminglanguages, standards, and software packages to build databases anddata pipelines. * Accomplish data cleansing, preparation, storage,and security. * Web-based data creation and editing through iDeditor or JDSM. * Data conflation activities through Hootenanny. *Upgrades to the UI and system capabilities to enhance userexperience. * Use business analytics and data validation to improvecampaign focus and output. * Establish and sustain a NOME UserForum. * Create and brief presentations around the community andconferences. Additional Application Requirement: You may be askedto complete one or more assessments in addition to the applicationyou submit on this website as part of your application to NGA.These assessments may include but are not limited to: * Onlinequestionnaires or assessments that require you to describe yourjob-related knowledge, skills, abilities, or other characteristicsthat are aligned with the mandatory and desirable qualifications ofthis job posting. The information you provide in the applicationyou submit must support the response you provide to thisquestionnaire. You will receive an email to describe any additionalassessments required. Please monitor your emails and complete anyrequired assessments as soon as possible. Mandatory QualificationsMANDATORY QUALIFICATION CRITERIA: For this particular job,applicants must meet all competencies reflected under the MandatoryQualification Criteria to include education (if required). Onlineapplications must demonstrate qualification by providing specificexamples and associated results, in response to the announcement'smandatory criteria specified in this vacancy announcement: *Demonstrated proficiency in applied programming and/or manipulationof data with a programing language such as Python, R or Java. *Demonstrated experience working with one or more databasemanagement systems, e.g. relational (Oracle, MySQL, Postgresql,etc.), noSQL (MongoDB, Accumulo, etc.), graph (Allegrograph,JanusGraphy, Neo4J, etc) to include experience with databaseretrieval methods and optimizations. * Demonstrated experienceworking with a range of data storage/access options, e.g. File(S3,FTP,etc.) and/or API(WFS, FeatureServer, Elasticsearch, SDK, etc.).* Demonstrated experience enabling access to data by way ofdatabases or dashboards. * Demonstrated experience cleaning,filtering, transforming data, and/or enriching data. EDUCATIONREQUIREMENT: A. Education: Bachelor's degree from an accreditedcollege or university in Computer Science, Engineering, InformationScience, Information Systems Management, Mathematics, OperationsResearch, Physical Sciences, Statistics, Technology Management, ora degree that provided a minimum of 24 semester hours in one ormore of the fields identified above and required the development oradaptation of applications, systems, or networks. -OR- B.Combination of Education and Experience: A minimum of 24 semester(36 quarter) hours of coursework in any area listed in option A,plus experience in developing, constructing, testing andmaintaining architectures and/or related technologies, or in arelated field that demonstrates the ability to successfully performthe duties associated with this work. As a rule, every 30 semester(45 quarter) hours of coursework is equivalent to one year ofexperience. Candidates should show that their combination ofeducation and experience totals 4 years. -OR- C. Experience: Aminimum of 4 years of experience in developing, constructing,testing and maintaining architectures and/or related technologies,or in a related field that demonstrates the ability to successfullyperform the duties associated with this work. -AND- IT-relatedexperience demonstrating each of the four competencies: Attentionto Detail, Customer Service, Oral Communication, and ProblemSolving. Highly Desired Qualifications QUALIFICATION CRITERIA: Inaddition to the mandatory qualifications, experience in thefollowing is desired: * Experience as a proven innovator andstrategic problem solver. * Familiarity with Department of Defense(DoD) and Intelligence Community (IC) activities, functions, andorganizational structures * Knowledge and understanding of NGAoperations, data infrastructure and architecture * Familiarity withcloud services as applied in the DoD and IC. * Knowledge ofsimplification and optimization of data automation workflows;streamlining of extract-transform-load (ETL) operations. 6.Knowledge of emerging technical skills, tools, and best practices.Additional Job Requirements You must be able to obtain and retain aTop Secret security clearance with access to SensitiveCompartmented Information. In addition, you are subject to aCounterintelligence Polygraph examination in order to maintainaccess to Top Secret information. All employees are subject to aperiodic examination on a random basis in order to determinecontinued eligibility. Refusal to take the examination may resultin denial of access to Top Secret information, SAP, and/orunescorted access to SCIFs. Employees with SCI access and who areunder NGA cognizance are required to submit a Security FinancialDisclosure Report, SF-714, on an annual basis in order to determinecontinued eligibility. Failure to comply may negatively impactcontinued access to Top Secret information, Information Systems,SAP, and/or unescorted access to SCIFs. Pay, Benefits, & WorkSchedule PROMOTION OPPORTUNITY: Promotion opportunities allowapplicants at all band levels to be considered. Qualifications forNGA positions do not include specific time-in-band requirements.NGA will emphasize quality of experience, rather than duration, andassess how the quality of the experience demonstrates possession ofthe knowledge, skills, abilities, and competencies necessary forsuccessful job performance in the NGA occupational structure. Band03 $64,948 - $133,465 PERMANENT CHANGE IN STATION: PCS expenses arenot authorized. Pay is only part of the compensation you will earnworking for the Federal Government. We offer a broad array ofbenefits programs and family friendly flexibilities to meet theneeds of you and your family. For more information on the array ofbenefits programs, please visit CoverLetter Applicants are not required to submit a cover letter. Theentire cover letter cannot exceed the specified limits provided inthe Cover Letter field (3,000 characters). Pages exceeding thislimit will not be considered. The cover letter is recommended butis not required for employment consideration with the NationalGeospatial-Intelligence Agency. Applicants should place theirnarrative information in the Cover Letter / Other ProfessionalDetails field. Who may apply External Applicants Only How to applyApplication submission involves applying using the IntelligenceCommunity's Applicant Gateway on-line application process. ONLYELECTRONIC SUBMISSIONS WILL BE ACCEPTED. How will I be evaluated?APPLICANT EVALUATION PROCESS: Applicants will be evaluated for thisjob opportunity in three stages: * All applicants will be evaluatedusing the Mandatory Qualification Criteria, * Qualified applicantswill then be evaluated by an expert or panel of experts using acombination of qualification criteria to determine thebest-qualified candidates, * Best-qualified applicants may then befurther evaluated through an interview process. Military retireeapplicants, if selected, may be impacted by the 180-day appointmentrestrictions of DODI 1402.01. HD personnel will provide additionalinformation if applicable. Applicants are encouraged to carefullyreview the Assignment Description, Additional Information ProvidedBy the Selecting Official, and the Qualification Requirements; andthen construct their resumes to highlight their most relevant andsignificant experience and education for this job opportunity. Thisdescription should include examples that detail the level andcomplexity of the performed work. Applicants are encouraged toprovide any education information referenced in the announcement.If education is listed as a mandatory requirement, only degreesobtained from an institution accredited by an accreditingorganization recognized by the Secretary, US Department ofEducation will be accepted. In accordance with section 9902(h) oftitle 5, United States Code, annuitants reemployed in theDepartment of Defense shall receive full annuity and salary uponappointment. They shall not be eligible for retirementcontributions, participation in the Thrift Savings Plan, or asupplemental or redetermined annuity for the reemployment period.Discontinued service retirement annuitants (i.e., retired undersection 8336(d)(1) or 8414(b)(1)(A) of title 5, United States Code)appointed to the Department of Defense may elect to be subject toretirement provisions of the new appointment as appropriate. (SeeDoD Instruction 1400.25, Volume 300, at All candidates will beconsidered without regard to race, color, religion, sex, nationalorigin, age, marital status, disability, or sexual orientation. NGAprovides reasonable accommodations to applicants with disabilities.Applications will only be accepted online. If you need a reasonableaccommodation for any part of the application and hiring process,please notify us at ...@nga.mil. The decision on grantingreasonable accommodation will be on a case-by-case basis.Conditions of Employment As a condition of employment at NGA,persons being considered for employment must meet NGA fitness foremployment standards. * U.S. Citizenship Required * SecurityClearance (Top Secret/Sensitive Compartmented Information) *Polygraph Test Required * Position Subject to Drug Testing * TwoYear Probationary Period * Direct Deposit Required DCIPS DisclaimerNGA utilizes all processes and procedures of the Defense CivilianIntelligence Personnel System (DCIPS). Non-executive NGA employeesare assigned to five distinct pay bands based on the type and scopeof work performed. The employee's base salary is established withintheir assigned pay band based on their unique qualifications. Aperformance pay process is conducted each year to determine apotential base pay salary increase and/or bonus. An employee'sannual performance evaluation is a key factor in the performancepay process. Employees on term or temporary appointments are noteligible to apply for internal assignment opportunity notices. Thisposition is a DCIPS position in the Excepted Service under 10U.S.C. 1601. DoD Components with DCIPS positions apply Veterans'Preference to preference eligible candidates as defined by Section2108 of Title 5 USC, in accordance with the procedures provided inDoD Instruction 1400.25, Volume 2005, DCIPS Employment andPlacement. If you are an external applicant claiming veterans'preference, as defined by Section 2108 of Title 5 U.S.C., you mustself-identify your eligibility in your application. Job Summary processing systems. They clean, prepare,and optimize data for consumption through the design andconstruction of massive reservoirs for big data. They solveproblems associated with database access and integration andunstructured data sets to provide clean, usable data for customersand IT counterparts. These engineers serve as integrators betweendata architects, data scientists, and other data consumers. Theyapply knowledge of scripting tools, programming languages,standards, and software packages to build the data pipelines thatenable faster, better, data-informed decision-making within theAgency. Additional Job Information ADDITIONAL INFORMATION: TheNational Geospatial-Intelligence Agency (NGA) serves as the worldleader in providing timely, relevant, accurate and actionablegeospatial intelligence (GEOINT). NGA's civilian, military andcontract personnel evaluate imagery, maps, charts, multiple layersof foundation data - such as terrain, elevation and gravity - andthe full spectrum of visible and invisible light in order to helpusers visualize what is happening at a particular place and time.NGA is in search of Data Engineers who understand data, dataarchitectures, data pipeline infrastructure, cloud solutions, andsecurity best practices. Data Engineers create data infrastructureand integrated data pipelines; transforming, enriching, anddelivering data for consumers. They may work independently and/oras part of a team of data and non-data professionals on projects ofvarying complexities. They will design logical and physical datamodels for data warehousing; develop robust data models, datadictionaries, and data flow diagrams. Data Engineers must be ableto operate at the tactical and strategic level while working in adynamic and sometimes ambiguous environment to deliver impactfulresults. They will leverage their strong interpersonal skills toeffectively communicate with mission owners at varying levelsinside and outside the Agency. As a Data Engineer, you will betasked against the Agency's biggest data challenges in support ofmissions such as National Intelligence, National Security, MilitaryOperations, and Disaster Relief and Preparedness, for a diverseaudience including the Department of Defense, the IntelligenceCommunity, and senior government officials up to and including theUnited States Congress and the President of the United States.Other duties may include: * Utilize a variety of languages andtools (e.g., scripting languages) to build data pipelines to pulltogether information from different source systems. * Design,construct, install, test, and maintain highly scalable datamanagement systems; * Develop data set processes for datadiscovery, modeling, mining, and production. * Integrate andprepare large, complex data sets that meet functional/non-functional business requirements. * Design and implement highperformance data pipelines for distributed systems and dataanalytics for customers. * Build, deploy, operate, and maintain bigdata analytics infrastructure. * Orchestrate large PB sized datastorage and compute clusters across bare-metal and cloud. * Deployand manage infrastructures based on Docker, Kubernetes, orOpenStack, and public Clouds such as Azure, AWS or Google CloudPlatform. * Create tool-chains for analytics and data scientistteam members that assist them in building and optimizing AIworkflows. * Experience with engineering data pipeline fromcollection and processing to visualization of SQL and NOSQL cybersecurity data sources for threat analysis and modelling. * Workwith Agency data and machine learning experts to improvefunctionality in our data and model life cycle managementcapabilities. * Develop enterprise interoperable coding and datastandards and create processes to ensure use of enterprise-widedata architecture capabilities. * Solve problems and deliversolutions with database access and data integration, define dataconflation, fusion, and de-confliction rules. * Collaborate withdata architects, data scientists, data stewards, and customers toenable more efficient and effective data-informed decision-making.* Apply expert knowledge of scripting, tools, programminglanguages, standards, and software packages to build databases anddata pipelines. * Accomplish data cleansing, preparation, storage,and security. * Web-based data creation and editing through iDeditor or JDSM. * Data conflation activities through Hootenanny. *Upgrades to the UI and system capabilities to enhance userexperience. * Use business analytics and data validation to improvecampaign focus and output. * Establish and sustain a NOME UserForum. * Create and brief presentations around the community andconferences. Additional Application Requirement: You may be askedto complete one or more assessments in addition to the applicationyou submit on this website as part of your application to NGA.These assessments may include but are not limited to: * Onlinequestionnaires or assessments that require you to describe yourjob-related knowledge, skills, abilities, or other characteristicsthat are aligned with the mandatory and desirable qualifications ofthis job posting. The information you provide in the applicationyou submit must support the response you provide to thisquestionnaire. You will receive an email to describe any additionalassessments required. Please monitor your emails and complete anyrequired assessments as soon as possible. Mandatory QualificationsMANDATORY QUALIFICATION CRITERIA: For this particular job,applicants must meet all competencies reflected under the MandatoryQualification Criteria to include education (if required). Onlineapplications must demonstrate qualification by providing specificexamples and associated results, in response to the announcement'smandatory criteria specified in this vacancy announcement: *Demonstrated proficiency in applied programming and/or manipulationof data with a programing language such as Python, R or Java. *Demonstrated experience working with one or more databasemanagement systems, e.g. relational (Oracle, MySQL, Postgresql,etc.), noSQL (MongoDB, Accumulo, etc.), graph (Allegrograph,JanusGraphy, Neo4J, etc) to include experience with databaseretrieval methods and optimizations. * Demonstrated experienceworking with a range of data storage/access options, e.g. File(S3,FTP,etc.) and/or API(WFS, FeatureServer, Elasticsearch, SDK, etc.).* Demonstrated experience enabling access to data by way ofdatabases or dashboards. * Demonstrated experience cleaning,filtering, transforming data, and/or enriching data. EDUCATIONREQUIREMENT: A. Education: Bachelor's degree from an accreditedcollege or university in Computer Science, Engineering, InformationScience, Information Systems Management, Mathematics, OperationsResearch, Physical Sciences, Statistics, Technology Management, ora degree that provided a minimum of 24 semester hours in one ormore of the fields identified above and required the development oradaptation of applications, systems, or networks. -OR- B.Combination of Education and Experience: A minimum of 24 semester(36 quarter) hours of coursework in any area listed in option A,plus experience in developing, constructing, testing andmaintaining architectures and/or related technologies, or in arelated field that demonstrates the ability to successfully performthe duties associated with this work. As a rule, every 30 semester(45 quarter) hours of coursework is equivalent to one year ofexperience. Candidates should show that their combination ofeducation and experience totals 4 years. -OR- C. Experience: Aminimum of 4 years of experience in developing, constructing,testing and maintaining architectures and/or related technologies,or in a related field that demonstrates the ability to successfullyperform the duties associated with this work. -AND- IT-relatedexperience demonstrating each of the four competencies: Attentionto Detail, Customer Service, Oral Communication, and ProblemSolving. Highly Desired Qualifications QUALIFICATION CRITERIA: Inaddition to the mandatory qualifications, experience in thefollowing is desired: * Experience as a proven innovator andstrategic problem solver. * Familiarity with Department of Defense(DoD) and Intelligence Community (IC) activities, functions, andorganizational structures * Knowledge and understanding of NGAoperations, data infrastructure and architecture * Familiarity withcloud services as applied in the DoD and IC. * Knowledge ofsimplification and optimization of data automation workflows;streamlining of extract-transform-load (ETL) operations. 6.Knowledge of emerging technical skills, tools, and best practices.Additional Job Requirements You must be able to obtain and retain aTop Secret security clearance with access to SensitiveCompartmented Information. In addition, you are subject to aCounterintelligence Polygraph examination in order to maintainaccess to Top Secret information. All employees are subject to aperiodic examination on a random basis in order to determinecontinued eligibility. Refusal to take the examination may resultin denial of access to Top Secret information, SAP, and/orunescorted access to SCIFs. Employees with SCI access and who areunder NGA cognizance are required to submit a Security FinancialDisclosure Report, SF-714, on an annual basis in order to determinecontinued eligibility. Failure to comply may negatively impactcontinued access to Top Secret information, Information Systems,SAP, and/or unescorted access to SCIFs. Pay, Benefits, & WorkSchedule PROMOTION OPPORTUNITY: Promotion opportunities allowapplicants at all band levels to be considered. Qualifications forNGA positions do not include specific time-in-band requirements.NGA will emphasize quality of experience, rather than duration, andassess how the quality of the experience demonstrates possession ofthe knowledge, skills, abilities, and competencies necessary forsuccessful job performance in the NGA occupational structure. Band03 $64,948 - $133,465 PERMANENT CHANGE IN STATION: PCS expenses arenot authorized. Pay is only part of the compensation you will earnworking for the Federal Government. We offer a broad array ofbenefits programs and family friendly flexibilities to meet theneeds of you and your family. For more information on the array ofbenefits programs, please visit CoverLetter Applicants are not required to submit a cover letter. Theentire cover letter cannot exceed the specified limits provided inthe Cover Letter field (3,000 characters). Pages exceeding thislimit will not be considered. The cover letter is recommended butis not required for employment consideration with the NationalGeospatial-Intelligence Agency. Applicants should place theirnarrative information in the Cover Letter / Other ProfessionalDetails field. Who may apply External Applicants Only How to applyApplication submission involves applying using the IntelligenceCommunity's Applicant Gateway on-line application process. ONLYELECTRONIC SUBMISSIONS WILL BE ACCEPTED. How will I be evaluated?APPLICANT EVALUATION PROCESS: Applicants will be evaluated for thisjob opportunity in three stages: * All applicants will be evaluatedusing the Mandatory Qualification Criteria, * Qualified applicantswill then be evaluated by an expert or panel of experts using acombination of qualification criteria to determine thebest-qualified candidates, * Best-qualified applicants may then befurther evaluated through an interview process. Military retireeapplicants, if selected, may be impacted by the 180-day appointmentrestrictions of DODI 1402.01. HD personnel will provide additionalinformation if applicable. Applicants are encouraged to carefullyreview the Assignment Description, Additional Information ProvidedBy the Selecting Official, and the Qualification Requirements; andthen construct their resumes to highlight their most relevant andsignificant experience and education for this job opportunity. Thisdescription should include examples that detail the level andcomplexity of the performed work. Applicants are encouraged toprovide any education information referenced in the announcement.If education is listed as a mandatory requirement, only degreesobtained from an institution accredited by an accreditingorganization recognized by the Secretary, US Department ofEducation will be accepted. In accordance with section 9902(h) oftitle 5, United States Code, annuitants reemployed in theDepartment of Defense shall receive full annuity and salary uponappointment. They shall not be eligible for retirementcontributions, participation in the Thrift Savings Plan, or asupplemental or redetermined annuity for the reemployment period.Discontinued service retirement annuitants (i.e., retired undersection 8336(d)(1) or 8414(b)(1)(A) of title 5, United States Code)appointed to the Department of Defense may elect to be subject toretirement provisions of the new appointment as appropriate. (SeeDoD Instruction 1400.25, Volume 300, at All candidates will beconsidered without regard to race, color, religion, sex, nationalorigin, age, marital status, disability, or sexual orientation. NGAprovides reasonable accommodations to applicants with disabilities.Applications will only be accepted online. If you need a reasonableaccommodation for any part of the application and hiring process,please notify us at ...@nga.mil. The decision on grantingreasonable accommodation will be on a case-by-case basis.Conditions of Employment As a condition of employment at NGA,persons being considered for employment must meet NGA fitness foremployment standards. * U.S. Citizenship Required * SecurityClearance (Top Secret/Sensitive Compartmented Information) *Polygraph Test Required * Position Subject to Drug Testing * TwoYear Probationary Period * Direct Deposit Required DCIPS DisclaimerNGA utilizes all processes and procedures of the Defense CivilianIntelligence Personnel System (DCIPS). Non-executive NGA employeesare assigned to five distinct pay bands based on the type and scopeof work performed. The employee's base salary is established withintheir assigned pay band based on their unique qualifications. Aperformance pay process is conducted each year to determine apotential base pay salary increase and/or bonus. An employee'sannual performance evaluation is a key factor in the performancepay process. Employees on term or temporary appointments are noteligible to apply for internal assignment opportunity notices. Thisposition is a DCIPS position in the Excepted Service under 10U.S.C. 1601. DoD Components with DCIPS positions apply Veterans'Preference to preference eligible candidates as defined by Section2108 of Title 5 USC, in accordance with the procedures provided inDoD Instruction 1400.25, Volume 2005, DCIPS Employment andPlacement. If you are an external applicant claiming veterans'preference, as defined by Section 2108 of Title 5 U.S.C., you mustself-identify your eligibility in your application.
Associated topics: data administrator, data analytic, data architect, data center, data engineer, data integration, data warehouse, database, database administrator, etl