engineering
Posted 4 weeks agoETL Developer
Mclean, United StatesOn-site
Requirements
- Vantor is a place for problem solvers, changemakers, and go-getters—where people are working together to help our customers see the world differently, and in doing so, be seen differently.
- Government Security Clearance at the TS/SCI level with required polygraph.
- experience in ETL processes, data integration, and working with large, complex datasets, including geospatial data.
- Responsibilities: Design, d evelop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform Learn the nuances of t he existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues Obtain an understand ing of existing NiFi flows with minimal support from others Develop new NiFi flows that a dopt best practices of existing NiFi flows Take feedback on NiFi flows and develop requested changes Take direction and
- requirements into specific actions Interface with a development cycle using a local development environment of container ized infrastructure and version control via Git and NiFi Registry Gain competency in g eospatial database design and employ best practices for table creation, indexing, and unique constraints Take feedback from analysts on nuances to support application data layers Programmatically manipulate and transform data from multiple sources Query and analyze large datasets using SQL Retrieve and
- requirements Develop Python in support of data science related efforts or ETL prototypes Minimum
- Experience: Bachelor’s degree with 8+ years of relevant experience, OR Master’s degree with 7+ years of experience, OR Doctorate with 6+ years of
- experience Degree in Computer Science, Systems Engineering, Geography, or a related technical field Active TS/SCI clearance with required polygraph U.S.
- Citizenship required Willingness to work onsite full-time Willingness to develop NiFi flows using existing best practices Strong understanding of ETL concepts and best practices Strong
- experience with databases for data management Proficiency in SQL for querying large datasets
- Experience with API integration and data retrieval Demonstrated
- experience with programmatic data manipulation Competency to rapidly adopt container ized development proficiency Competency to rapidly adopt AWS architecture proficiency Competency to rapidly adopt NiFi registry and Git for code management Preferred
- Qualifications: C reativity to e xperiment and recommend best practice cod ing improvements Drive to adopt and recommend AI into development processes Ability to design and develop custom NiFi processors using Java