Senior Software Engineer, Platform
Engineering – Senior Software Engineer, Platform – Atlanta or DC Area Preferred – Full-Time
DNS and netflow telemetry lands in a data lake in our own AWS account, detection pipelines score it, and the findings are written into an intelligence graph that products and analysts query. Security researchers design the detections. This team builds everything around them, including the graph and the services that serve it.
Our stack is Amazon EKS, Spark, Apache Iceberg and Delta Lake, Argo Workflows, Argo CD, Crossplane, and Python and Scala. We do not expect you to have used all of it. We do expect that you have worked in each of these areas, in whatever tools you used at the time: continuous integration and delivery, infrastructure as code, distributed data processing, container orchestration, a data lake on an open table format, and Python.
This role builds and operates the graph serving layer. The canonical record lives in the data lake; the graph database is derived from it and rebuildable from scratch. We have not chosen a graph store yet — you will run that evaluation, make the recommendation, and then operate what you chose.
Atlanta or DC Area Preferred
Full-Time
Remote
Responsibilities
- graph serving layer. Build the pipeline that produces the graph, keep it current as new findings land, and make sure evidence that ages out actually leaves the store.
- Selecting the graph store. Once the data model is far enough along to state its access patterns, evaluate candidates against them: traversal across several hops with filters at each step, queries against nodes with very high edge counts, bulk rebuild throughput, and efficient deletion as data ages out. You run the evaluation, make the recommendation, and then operate what you chose.
- The query and access layer that analysts and downstream products read the graph through.
- This team's footprint on the existing platform. VLI already runs the EKS clusters and the deployment tooling. You own what this team puts on it: Crossplane compositions, Argo CD applications, deployment pipelines, and monitoring for the graph and its services.
Required Qualifications
- You have operated a stateful data store in production. Not just used one. Sizing, upgrades, and a restore you performed yourself.
- Backend service and API development.
- Enough Spark and lake table experience to write the pipelines that build the serving layer.
- Query performance work: reading plans, designing indexes, fixing slow queries.
- Working experience across continuous integration and delivery, infrastructure as code, distributed data processing, container orchestration, a data lake on an open table format, and Python.
- Must be a US citizen
Preferred Qualifications
- Graph database experience is a plus, not a requirement. The distributed systems and operations experience is what matters.
- Our specific stack: Amazon EKS, Crossplane, Argo CD, Argo Workflows.
- Scala, alongside Python.
Why Join Us
- Fully remote within the United States, with flexible working hours
- A foundational technology decision that is still open, and yours to make
- A modern stack and an engineering culture that values automation and best practices