Evaluate and ensure data integrity across various formats through mature, high-quality, well-organized application code with fully developed unit and integration testing and telemetry
3+ years’ experience developing, maintaining, and testing big data pipelines.
A strong technical advocate with a background in Python or Scala + SQL. Preferably familiar
with both on-prem and cloud data systems, for example, AWS or Azure; SQL and NoSQL
Experience with shell scripting and Unix command line, as well as virtual environments.
Strong understanding of data modeling and ETL / ELT best