Senior Software Engineer - Autonomy Safety Metric
Foster City, CASoftwarePosted
- Category
- Engineering
- Specialty
- Data
- Level
- Senior
- Work arrangement
- Hybrid
- Employment
- Full-time
- Hiring in
- US
- Tags
- Python
- AWS
Job description
In this role, you will:
-
Build and maintain the Behavior Evaluation data pipelines (PySpark/zspark medallion architecture on Databricks, EMR Serverless and Airflow) that produce weekly per-geofence estimates.
-
Turn the statistical method (sampling, triage weights, mileage sharing, projections) into tested, reproducible code with checks that fail loudly when the data is bad.
-
Build tools that cut the manual work in each weekly run.
-
Work with cross functional stakeholders so the methodology is applied consistently in code and in clearance reports.
-
Help adapt to new release methodologies and new geofences.
Qualifications:
-
7 - 9 Years of experience or 5+ years with a strong data-platform track record
-
Expert Python, with production experience in PySpark/Spark and Pandas
-
Experience designing scalable batch data pipelines: orchestration, Delta/lakehouse tables, idempotent backfills
-
Solid grounding in applied statistics: sampling, weighting, estimators, confidence intervals
-
Strong testing and CI habits for data code
Bonus Qualifications:
-
Experience with autonomous-vehicle simulation, safety metrics or triage workflows
-
Experience putting ML models into production in a data pipeline
-
Experience with Databricks and AWS (EMR Serverless, S3)